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A  CHARACTERIZATION  OF  THE  GAMMA 
DISTRIBUTION  FROM  A  RANDOM  DIFFERENCE  EQUATION 


by 

Eric  S.  Tollar 


ABSTRACT 

A  characterization  of  the  gamma  distribution  is  considered  which  arises 
from  a  random  difference  equation.  A  proof  without  characteristic  functions  is 
given  that  if  V  and  Y  are  independent  random  variables,  then  the  independence 
of  V  •  Y  and  (1  -V)  •  Y  results  in  a  characterization  of  the  gamma  distribution 
(after  excluding  the  trivial  cases). 


1 .  Introduction 


The  general  random  difference  equation  is  defined  recursively  by 

<*•»  VMnyn-l*V”il- 

where  Mn  are  random  d  x  d  matrices ,  and  and  Y^  are  random  d-vectors .  This 
equation  has  proven  useful  as  a  model  for  physical  phenomena  (see  Bernard, 

Shenton  and  Uppuluri  (1967),  and  Cavalli-Sforza  and  Feldman  (1973)),  and  as  a 
useful  mathematical  tool  (see,  for  example,  Solomon  (1975)). 

Kesten  (1973)  has  established  some  general  conditions  under  which  Yr  con¬ 
verges  in  distribution  for  dal  as  n  approaches  infinity.  Paulson  and  Uppuluri 
(1972),  and  Verwaat  (1979)  have  some  partial  results  on  the  characterization  of 
the  limiting  distribution  of  (1.1)  for  d=l. 

A  very  specific  version  of  (1.1)  when  d  =  2  will  be  examined.  Under  reason¬ 
able  conditions  it  is  shown  that  asymptotic  independence  of  Y,  and  Y_  results 

i,n  Z,n 

in  a  characterization  of  the  gamma  distribution.  More  specifically,  it  is  shown 

that  often  asymptotic  independence  of  Y,  and  Y_  implies  that  there  are  inde- 

i,n  Z,n 

pendent  random  variables  V  and  Y  where  V  •  Y  and  (1  -V)  *  Y  are  also  independent. 

In  the  non-trivial  cases  this  implies  that  Y  has  a  gamma  distribution,  and  V  has 
a  beta  distribution. 

As  can  be  easily  shown,  this  is  yet  another  generalization  of  the  celebrated 
characterization  of  the  gamma  distribution  of  Lukacs  (1955),  (for  an  example  of 
other  generalizations,  see  Marsaglia  (1974)).  A  simple  proof  of  this  (i.e., 
one  without  characteristic  functions)  is  given  in  section  2  of  this  paper. 

Section  3  is  devoted  to  the  difference  equation  from  which  the  characterization 


A  Characterization  of  the  Gamma  Distribution 


In  the  following,  it  is  said  X~T(X,  $)  if 


(2.1) 

and  X~B(o,  g)  if 

(2.2) 


P(XSx)  =  I(x>0)r(CO‘1/Jx(Xy)P-1e‘Xydy, 


p(xsx)  =  1(0  <  x<  i)B(a,  er'/Jv®"1*1 "  y)3‘ldy 


Also,  for  any  random  variable  X  and  arbitrary  set  A,  we  define  the  random  var 
iable  XA  by  the  restriction  of  X  to  the  set  A.  That  is. 


(2.3) 


P(XA  Sx)=  P(X  e  A)-1P(X  sx,  X  e  A) 


The  following  lemma  proves  to  be  useful  in  this  section. 


LEMMA  3.1.  Let  U,  IV  be  independent  random  variables,  where  U>W>0.  Then 
U(U-W)-1  and  U-W  are  independent  if  and  only  if  Urc,  W  =  d,  c>d>0. 


PROOF.  It  is  clear  there  must  be  a  constant  e  where 


(2.4) 


P (U  s  e)  =P(WSe)  =  1. 


(2.5) 


b^  =  inf  {x:  P(W<:x)*l}, 
b2  =  sup  (x:  P(U2x)  =  l). 


Then,  since  U  -  W £ b2  -  bj,  Wsb^, 


(2.6) 


U(U-W)-1  =  1  +  W(U  -  V.')"1  ib2(b2-b1)_1 


From  the  definition  of  bj  and  b2,  it  is  equally  clear  that  for  all  e>0, 
P(U  -  W  <  b2  -  bj  ♦  e)  >  0.  Because  U-W  and  U(U  -  W)‘l  are  independent. 


-  3  - 

(2.7)  P  (U(U  -  if)  - 1  >  b2  (b2  -  bj  ♦  e)  - 1 ) 

=  P(U(U  -  W)-1  >  b2(b2  -  bj  +  e)’1  |U  -  W  <  b2  -  bx  e)  . 

Since 

(2.8)  {m:  U- W<b2-b1  +  e)c{u:  (U  <  b2  ♦  e)  n  (W  >  ^  -  e)  >, 

U-W<b2~b1  +  e  therefore  implies  that  U(U  -  W)-1  >  1  +  (bj  -  e)  (b2  -  bj  +  e)”1  = 

b2(b2  -  bi  +  e)"1 .  Therefore,  for  all  e>0, 

(2.9)  POKU-W)’1  >b2(b2-b1  +  e)-1|U-W<b2-b1  +  £)  -1. 

Coupled  with  (2.7),  (2.9)  implies  that 

(2.10)  P(U(U-W)_1  fcbjOjj-bj)’1)  -1. 

Combined  with  (2.6),  it  is  established  that  P(U(U  -  W)-1  = b2(b2  -  bj)"1)  =  1,  which 

in  turn  establishes  the  lemma,  where  c*bj  and  d  =  b^.  □ 

As  a  first  step  in  showing  that  for  independent  random  variables  V  and  Y, 

V  •  Y  being  independent  of  (1  -  V)  •  Y  leads  to  a  characterization  of  the  Gamma 
distribution,  the  following  theorem  is  established. 

THEOREM  2.2.  If  Y  >  0,  and  if  V  and  Y  are  independent,  then  VY  and  (1  -  V)Y  are 


independent  if  and  only  if  one  of  the  five  conditions  below  are  true: 


PROOF .  Since  sufficiency  is  obvious,  only  the  necessity  of  the  conditions  need 
be  established.  For  convenience,  let 


X  =  VY  and  Z  =  (1-  V)Y. 


Ax  =  {Y  =  0}  =  {X  =  0,  Z  =  0} 

A2»{Y>0,  V<0}  =  {X<0,  Z>0} 

a3  =  {y>o,  V  =  0}  =  {X=0,  Z>0> 

A4  =  {Y>0,  0<V<1}  =  {X>0,  Z>0} 

Ag  =  {Y>0,  V  =  1}  =  (X  >  0,  Z  =  0) 

A  =  {Y  >  0 ,  V>1)  =  {X>0,  Z<0}. 

6 

From  (2.3),  it  is  easily  seen  that  since  V  and  Y  are  independent,  so  are  V. 

i 

and  Ya  for  all  i.  Similarly  X  and  Z  being  independent  implies  X.  and  ZA  are 
l  Ai  Ai 

also. 

The  proof  requires  little  other  than  the  observation  that  since  Y  and  V  are 
independent,  and  X  and  Z  are  also  assumed  to  be  independent,  then  since 

Y{Y>0}~Y{Y>0,  VcB) *  we  have  *°r  i*l,  j*l 

( 2.13 )  VA  ~Ya  . 

i  j 

It  can  be  similarly  seen  that  for  is  4,  j  s  4 


(2.11) 

Further,  let 

(2.12) 


(2.14) 

and  for  2s:is4,  2sjs4, 
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(2. IS) 


It  can  then  be  shown  that  only  the  5  conditions  of  the  theorem  do  not  violate 
one  of  (2.13),  (2.14),  or  (2. IS). 


Since  P(Y  » 0)  =  1  is  condition  1  of  the  theorem,  it  is  assumed  that  P(Y  =  0)  <  1 
throughout.  Two  cases  will  be  considered;  when  P(0<V<1)  =0  and  when 
P(0<V<  1)  >0. 

Case  I:  P(0<V<  1)  =  0. 

P(0<V<1)*0  implies  P(X>0,  Z>0)=0.  Therefore,  either  P(X  >  0)  =  0,  or 

P(Z>0)=0.  Assume  that  P(Z > 0)  = 0 .  As  such,  P(A^  u  A^  u  A^)  -  0. 

If  P (A  )  >  0 ,  then  X  >0,  -Z  >0,  and  X  ♦  Z.  =Y  >0.  Since  X.  ,  -Z, 

o  A6  6  o  o  o  h6 

are  independent,  and  X  +  Z.  =Y  and  X  (X.  +  Z.  )_1  =V  are  also  independent, 

6  6  A6  A6  6  o  A6 

the  application  of  lemma  2.1  where  K  =  X.  ,  ,,=  -Z.  yields  X.  =c,  Z.  = -d,  and 

6  A6  A6  A6 

Y.  =  c  -  d,  for  c>d>0.  If  in  addition  P(Ac>0),  then  X.  =  Y.  .  However,  from 
6  b  A5  A5 

(2.13)  and  (2.14)  it  must  be  true  that  X.  ~X  and  Y.  ~Y  if  both  P(A  )  >  0 

AS  A6  A5  A6  b 

and  P (A^)  >0.  Thus  at  most  one  of  A<.  and  A^  can  have  probability  greater  than  0. 

Assume  that  P(A  )  >  0  (and  therefore  P(A0 u A, u A.  u A,)  = 0) .  Then  from  the 
*>  /  o  4  O 

independence  of  Y  and  V  it  can  be  seen  that 

(2.16)  P(Y  =  0,  V*  1)  =P(Y  =  0)P(V*  1)  =  P(Y  =  0)P(Y  =  0,  V*  1)  . 

As  such,  P(Y  =  0)  =  1,  which  is  condition  1,  or  P(Y  =  0,  V*  1)  =0,  which  yields 

P(V=1)=1  (condition  3). 

If  P(A&)  > 0  is  assumed  instead,  a  similar  condition  based  on  the  independ¬ 
ence  of  X  and  Z  will  yield  that  P(Ag)  =0  or  P(A^)  a  1  which  are  conditions  1  and 
4,  respectively. 

Finally,  if  it  is  instead  assumed  that  P(X>0)  *0,  then  by  similar  arguments 
it  can  be  shown  that  one  of  condition  1,  condition  2  or  condition  4  must  apply. 


Case  II:  P(0  <  V  <  1)  >  0. 

Since  it  is  assumed  that  P(Y = 0)  <  1,  it  follows  that  P(A^)  = 

P(Y>0,  0<V<1)>0.  Clearly  X.  >0,  Z.  >0,  X.  and  Z.  are  independent.  Also, 

A4  A4  A4  A4 

V.  and  Y.  are  independent  and  as  can  be  seen  from  (2.11), 


> 


Z.  ) 


-1 


Therefore  Lukacs'  characterization  of  the  gamma  distribution  yields. 


xA  ~r(x,  a),  zA  ~r(x,  b), 

4  4 

which  implies 

Y.  ~T(X,  a+  B),  V.  ~  B(a,  B)  . 

A4  A4 

If  P(A  )  >  0,  then  letting  U  =  Z.  ,  W  =  -X.  ,  appealing  to  lemma  2.1  again 
Z  A2  2 

yields  that  Z.  =c,  X.  = -d.  However,  from  (2.15),  ZA  ~Z  ,  which  implies  that 
2  2  A2  A4 

P(A2)  =0.  Assuming  that  P(A&)  >0  yields  a  similar  contradiction  for  the  distri¬ 
bution  of  X. 

If  P(A^)  >  0,  then  Ya  = ZA  ,  since  XA  =0.  But  (2.13)  and  (2.15)  imply  that 

Ya  ~T(X,  a  ♦  B)  and  Z A  ~T(X,  B) .  As  such,  P(Aj)*=0.  A  similar  argument  yields 
3  3 

that  P(Ag)  *  0. 

These  observations  collectively  imply  P(0<V<  1)  *  1.  Finally,  the  observa¬ 
tion  that  the  independence  of  X  and  Z  implies 

P(A  )  =P(X*0,  Z  =  0)  *P(X*=0)P(Z*0)  =P(A  )2 


(2.17) 


-  7  - 

yields  that  P(Aj)  = 1  which  is  condition  1,  or  P(A^)  =0  which  yields  P(A4)  =  1, 
and  in  turn  implies  condition  5.  0 

In  the  next  theorem,  the  condition  that  Y  S  0  in  theorem  2.2  is  removed. 

THEOREM  2.3.  If  V  and  Y  are  independent  random  variables,  then  VY  and  (1  -  V)Y 
are  independent  if  and  only  if  one  of  the  conditions  below  are  true: 

1)  Y  =  0 , 

2)  Vi  0, 

3)  V=l, 

4)  Y=  c,  V  =  d, 

5)  Y~T(X,  a  +  0)  ,  V~B(a,  0), 

6)  -Y  ~  T(A ,  a  +  0) ,  V  ~  B(a,  0). 

PROOF .  Again  the  sufficiency  is  obvious,  so  only  the  necessity  of  the  conditions 
need  be  established.  Clearly  if  either  P(YiO)  *  1  or  P(Y  SO)  =  1,  then  by  theorem 
2.2,  the  proof  is  complete.  It  will  therefore  be  assumed  throughout  that 
P(Y>0)  >0  and  P(Y<0)  >0,  which  will  be  shown  to  generate  a  contradiction. 

As  in  theorem  2.2,  again  sets  are  defined  and  restricted  random  variables 
are  examined.  The  sets  are: 

'  ai  =  {Y  =  0>  =  {X  =  0,  Z  *  0} 

A2*{Y>0,  V<0}  =  {X<0,  Z>0,  X  +  Z>0) 

A3  =  {Y>  0,  V  =  0}  =  {X  =  0,  Z  >  0} 

A4  =  {Y>0,  0<V<1}  =  {X>0,  Z  =  0} 

As  =  {Y>0,  V  =  1}»{X>0,  Z  =  0) 

(2.18)  Afi  =  {Y>  0,  V  >  1}  =  {X  >  0,  Z<  0,  X  +  Z  >  0} 

A7b{Y<0,  V<0)b{X>0,  Z<0,  X  +  Z<0) 

Ag  *  (Y  <  0,  V  =  0)  =  {X*0,  Z<  0} 

A9  =  {Y<0,  0  <  V  <  1}  =  {X  <  0,  Z<0) 

A10  =  {Y<0,  V»1}  =  {X<0,  Z  «  0} 

An  =  {Y<0,  V>1)*{X<0,  Z>0,  X  +  Z<0). 


Note  that  while  all  are  of  the  form  =  {Y  e  A,  VeB),  the  sets  A2,  A^, 
A7  and  A^  cannot  be  expressed  as  A.  ={X£A,  ZcB},  for  AeR,  B  c  R. 

If  it  is  temporarily  assumed  that  P(0<V<1)>0,  then  P(X>0,  Z>0)>0, 
P(X<0,  Z<0)>0.  Since  X  and  Z  are  independent,  this  condition  also  implies 
that  P(X>0,  Z<0)  >0  and  P(X<0,  Z  >  0)  >0.  Thus  P(A2uAn)  >0,  P(A4)  >0, 
P(A6uAy)  >0,  P(Ag)  >0. 

By  appealing  to  Lukacs'  characterization  as  in  theorem  2.2,  it  follows  that 


(2.19) 


V~r(v  “P*  zA„~r(V  eP’  ya  ~r(V  VBP 

4  4  4 

-X  ~r(X2,  a2),  -Z  ~r(X2,  B2),  -Ya  ~  r(X2,  a2+B2) 


By 


arguments  similar  to  those  of  (2.13), 


vv 


-a6ua? 


r(x 


(2.14)  and  (2.15),  it  follows  that 

*  r(x2,  b2) 


(2.20) 


< 


u  A 
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r(x2,  c*2)  *  r(Xj,  pj) . 


Since  P(A^uA7)  >0,  it  will  be  temporarily  assumed  that  P(A^)  >0.  Clearly,  it 
follows  from  (2.13)  that 


(2.21) 


Oj  +  Bj)  . 


It  can  be  trivially  verified  fron  (2.20)  for  xg>0,  Zq  <  0  that 


o.  a  -1  -X  x  B,  3,-1  X  z 
X.  x  1  e  1  X  ^(-z)  e  z  dxdz 

(2.22)  P(X  sx  Z  *z  )=//  -i - - - 

6  6  U  A  r(a,)r(B,)P(AJ 


whereA=((x,  z) :  x<xn,  z<zn. 


x+z>0).  Because  Y  =  X.  ♦  Z.  , 


from  a 


-  9  - 


transformation  of  variables  in  (2.22),  for  (2.21)  to  be  also  true  it  must  follow 
that 


(2.23) 


8i  +  Bj^-l 


r(a1*B1)  X/2 
r(a1)r(131)P(A6) 


-00  „  1 

J0(y  +  w) 


a,-l  -  (X^  +  X2)w  62-l 
e  w  dw. 


Examination  of  the  behavior  of  the  two  sides  of  this  equation  (particularly  as  y 
approaches  0)  yields  that  equality  is  impossible  for  a^>0,  g^>0.  As  such, 

P(A^)  =0.  It  is  clear  an  identical  argument  will  yield  that  P(A_,)  =0.  As  such, 
it  must  be  true  that  the  assumption  of  P(0<V<  1)  >  0  leads  to  a  contradiction, 
so  P(0<V<  1)  =0,  and  therefore  P(X>0,  Z  >  0)  =P(X<0,  Z  <  0)  =0. 

If  P (V  <  0)  >0,  then  since  both  P(Y  <  0)  >  0  and  P(Y  >  0)  >  0,  we  have  that 
P(V  •  Y  >  0)  >  0  and  P((l  -  V)Y  >0)  >0.  This  contradicts  P(X  >0,  Z  >  0)  =  0,  since  X 
and  Z  are  assumed  to  be  independent.  As  such,  P(V<0)  =0.  Similarly  P(V  >  1)  >0 
contradicts  P(X  <0,  Z  <  0)  =  0 ,  and  therefore  P(V  >  1)  =  0.  If  both  P(V  =  1)  >  0  and 
P(V  =  0)  >0,  then  again  P(X>0)  >0  and  P(Z  >  0)  >0,  respectively,  which  is  again  a 
contradiction.  Therefore  we  finally  have  that  if  P(Y  >  0)  >0  and  P(Y  <  0)  >0,  then 
P(V  =  0)  =  1  (condition  2),  or  P(V  «  1)  -  1  (condition  3).  □ 


In  the  next  section,  the  random  difference  equation  which  motivated  this 
characterization  of  the  gamma  distribution  is  given. 


3.  Concluding  Comments 

Paulson  and  Uppuluri  (1972)  and  Verwaat  (1979) ,  have  characterized  some  of 
the  limiting  distributions  for  a  random  difference  equation  with  one  dimension. 
For  a  very  specific  two-dimensional  model,  the  above  characterization  of  the 
gamma  arises  when  the  asymptotic  independence  of  the  two  compartments  is  consid¬ 


ered. 


The  equation  to  be  considered  is  difined  for  n  >  0  by  the  recursive  equation 


(3.1) 


Y,  ] 
l»n 

v 

n 

H 

1 

c 

H 

*-  -  -  ■ 

+ 

Un 

.  Y2,n 

0 

W 

n 

y 

l  2,n-l  j 

0 

.  , 

where  W^,  up  is  an  i.i.d.  sequence,  independent  of  each  other  and  Yg. 

Kesten  (1973)  has  given  some  conditions  under  which  the  convergences  in  distribu¬ 
tion  of  ^  is  assured.  Should  ^  converge  in  distribution  to  Y  =  (Yj.Yp,  then  for 


(3.2) 


$(s,  t)  *  E(exp(is  Y1  +  it  Y2)) 
„  »Ks)  =  E(exp(is  Up 


it  is  easily  verified  that 


(3.3)  <Ks,  t)  =<Ks)E4»(sV1  +  t(l-V1),  twp. 
From  the  assumed  independence  of  Y^  and  Y2  it  follows  that 

(3.4)  <Ks,  t)  *tKs)E<KsV1  +  t(l-V1),  0)E$(0,  twp 
and  that 


(3.5)  4>(s,  t)  =t|)(s)E4)(sV1,  0)E$(t(l  -  vp ,  0)E<K0,  tWp  . 

Define  the  set  A  c  p.  by 


(3.6)  AMs:  OKs)  =0)  u  (E«J» (0 ,  sWp  =0)}. 

If  Ac  is  dense  in  R  then  by  equating  (3.4)  and  (3.5)  it  is  clear  that  for  all 
s,  t  c  R2 

E<KsV1  +  t(l-Vp,  0)  *  Ey (:.V j ,  0)E<Kt(l-Vp,  0). 


(3.7) 
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From  (3.7)  it  is  cle,  r  that  should  Ac  be  dense,  then  Y^  and  are  independent 
if  and  only  if  VjYj  and  (l-V^Yj  are  independent.  This  is  the  concern  of  sec¬ 
tion  2. 

Q 

The  most  reasonable  and  realistic  condition  on  (U  ,  V  ,  W }  in  order  for  A 

n  n  n 

to  be  dense  is  given  in  the  following  corollary. 

COROLLARY  3.1.  If  U  2  0,  OSV  Si.  and  W  2  0  for  all  n,  then  Y,  _  and  Y„  _  are 
———————————  —  n  n  -  n  i  »n  t  ,n 

asymptotically  independent  if  and  only  if  Un  has  a  Gamma  distribution  and  Vn  has 
a  beta  distribution,  or  one  of  the  four  trivial  conditions  of  theorem  2.2  are 
true. 

The  proof  follows  immediately  from  theorem  2.2,  the  conditions  for  conver¬ 
gence  of  (3.1)  given  in  Kesten  (1973),  and  the  fact  that  the  characteristic 
functions  of  non-negative  random  variables  have  dense  support  (see  Smith  (1962)). 

Clearly,  other  restrictions  of  Un,  V^,  will  yield  that  Ac  is  dense,  how¬ 
ever,  the  more  interesting  problem  of  characterizing  the  asymptotic  independence 

of  Y.  and  Y_  appears  to  be  an  open  question. 
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